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Project  Title:  Light-Based  Modeling  and  Control  of  Circadian  Rhythm 
PI:  John  T.  Wen,  Agung  Julius,  Rensselaer  Polytechnic  Institute, 

Objective: 

The  full  scope  of  this  research  is  to  develop  a  robust  and  reliable  circadian  phase 
estimation  system,  and  use  it  for  model  identification  and  light-based  control  design. 
The  objective  of  this  STIR  grant  is  to  develop  preliminary  results  in  the  following 
directions  to  lay  the  foundation  of  the  full  research. 

1.  Circadian  phase  estimation  and  control:  Demonstrate  the  applicability  of  the 
adaptive  notch  filter  (ANFJ  to  extract  circadian  phase  from  noisy  Drosophila 
locomotive  activity  measurements  and  the  efficacy  of  using  the  ANF  output  for  light 
based  circadian  phase  control. 

2.  Pathway  to  human  deployment:  Demonstrate  the  feasibility  of  a  human  wearable 
sensor  that  could  be  used  with  the  ANF  algorithm  to  extract  the  circadian  phase  of 
human  users. 

Approach 

1.  Use  our  existing  Drosophila  testbed  which  consists  of  twelve  32-fly  boxes  with 
regular  locomotive  activity  measurements  and  blue  LED  control  (at  one-minute 
resolution]  to  generate  data  for  the  construction  of  the  phase  response  curve 
(PRC)  using  the  ANF  algorithm  to  compare  with  known  results.  The  ANF  output 
will  be  used  to  control  the  LED  to  achieve  desired  phase  shift  using  the  optimal 
control  algorithms  that  the  Pis  have  developed. 

2.  Extend  the  ANF  approach  to  multiple  sensor  measurements. 

3.  Develop  light-based  control  strategy  using  the  PRC  information. 

Scientific  barriers 

1.  The  Drosophila  locomotive  activity  data  is  noisy  and  is  masked  by  other  factors 
such  as  stimulation  through  the  visual  pathway.  The  parameters  in  ANF  must 
be  tuned  to  balance  between  two  competing  objectives:  fast  response  (the  ANF 
output  closely  tracks  the  true  circadian  phase  without  excessive  delays)  and 
noise  rejection  (the  ANF  output  is  not  overly  influenced  by  noise  and  non- 
circadian  factors). 

2.  The  current  ANF  approach  is  based  on  a  single  sensor  stream.  In  human 
deployment,  wearable  sensors  will  likely  be  used  which  could  provide  multiple 
sensor  streams,  such  as  actigraphy,  heart  rate,  skin  temperature,  etc.  Effective 
sensor  fusion  scheme  integrating  these  multiple  streams  of  sensors  is  currently 
lacking. 

3.  There  are  multiple  circadian  oscillator  models.  A  model  suitable  for  light-based 
control  design  must  balance  between  model  complexity  and  fidelity.  Model- 
based  control  faces  the  issue  of  controlling  on  the  unit  circle  S1. 


Significance 

Current  circadian  estimation  scheme  is  based  on  days  of  data.  The  ANF  method 
could  reduce  the  estimation  delay  to  hours  instead  of  days.  This  would  allow 
feedback  implementation  of  light-based  circadian  phase  control  strategy  using 
wearable  sensors.  Effective  circadian  phase  would  be  important  for  shift  work 
hours  or  travel  across  multiple  time  zones. 

Accomplishments 

1.  We  have  applied  the  phase  reduction  technique  to  circadian  oscillation  and 
came  up  with  the  first  complete  solution  of  the  time  optimal  control  problem. 
See  Figure  1  for  the  structure  of  the  feedback  control,  which  is  determined 
completely  by  the  PRC  [and  the  maximum  light  amplitude).  Figure  2  shows 
the  comparison  between  various  control  strategies.  The  optimal  feedback 
strategy  reduces  entrainment  time  to  less  than  a  third  of  the  periodic 
entrainment.  The  preliminary  version  of  this  work  was  presented  at  the 
IEEE  Conference  on  Decision  and  Control  in  December  2013.  The  expanded 
result  has  been  submitted  to  the  IEEE  Transaction  of  Automatic  Control. 

2.  We  have  applied  the  ANF  to  Drosophila  data  and  constructed  PRC  that  is 
comparable  to  the  result  in  the  literature  using  off-line  methods.  The  result 
is  shown  in  Figure  3. 

3.  We  have  developed  a  multi-ANF  approach  to  incorporate  multiple  sensor 
streams  (possibly  in  different  rates)  for  circadian  phase  estimation.  The 
structure  of  the  filter  is  shown  in  Figure  4.  The  paper  has  been  submitted  to 
the  International  Journal  on  Adaptive  Control  and  Signal  Processing. 

Collaborations  and  leveraged  funding 

This  project  leverages  the  Lighting  and  Health  research  thrust  in  the  Smart  Lighting 
Engineering  Research  Center  (SLERC)  at  Rensselaer  Polytechnic  Institute  funded  by 
the  National  Science  Foundation.  SLERC  supports  human  circadian  study  with 
leading  circadian  researcher,  Dr.  George  Brainard  at  Thomas  Jefferson  University, 
and  the  Director  of  the  Sleep  Institute  at  the  University  of  New  Mexico,  Dr.  Lee 
Brown.  The  Pis  participate  in  this  collaborative  research  which  focuses  on  the 
human  subject  study. 

Conclusions 

This  grant  has  allowed  us  to  make  significant  progress  in  circadian  rhythm  control 
research.  This  lays  a  strong  foundation  to  investigate  the  effect  of  sleep  (using  the 
two-process  model)  and  performance. 

Future  plans 

Demonstrate  PRC-based  control  for  Drosophila  for  robust  closed  loop 
circadian  rhythm  entrainment. 

Develop  light-based  performance  control  by  using  the  two-process  model. 


Publications: 


J.  Zhang,  J.T.  Wen,  A.  Julius,  "Optimal  and  Feedback  Control  for  Light-Based  Circadian 
Entrainment,”  Proc.  IEEE  Conf.  Decision  and  Control,  Florence,  Italy,  2013. 

J.  Zhang,  W.  Qiao,  J.T.  Wen,  A.  Julius,  "Light-Based  Circadian  Rhythm  Control: 
Entrainment  and  Optimization,”  Automatica,  68,  June,  2016.  pp.  44-55. 

A.  Julius,  J.  Zhang,  W.  Qiao,  J.T.  Wen,  "Multi-input  Adaptive  Notch  Filter  and  Observer 
for  Circadian  Phase  Estimation,”  to  appear  in  the  International  Journal  on  Adaptive 
Control  and  Signal  Processing,  2016. 

W.  Qiao,  J.T.  Wen,  A.  Julius,  "Entrainment  Control  of  Phase  Dynamics,”  to  appear  in 
IEEE  Transaction  on  Automatic  Control,  April,  2017. 


®- 10 


0  (hour) 


Figure  1  Feedback  entrainment  algorithm,  determined  completely  by  the  PRC.  The 
3-hour  switching  zone  is  due  the  S1  topology  of  the  phase  space.  The  algorithm  is  in 
fact  optimal  in  terms  of  entrainment  time. 
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Figure  2  Comparison  of  optimal  entrainment  cost  between  open  loop  periodic 
entrainment  (at  50%  duty  cycle),  optimal  open  loop  entrainment,  feedback 
entrainment,  and  subtractive  entrainment.  The  feedback  entrainment  is  optimal, 
and  provides  additional  robustness. 
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Figure  3  Extension  of  ANF  to  multiple  sensor  inputs 
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Figure  4  Phase  response  curve  (PRC)  for  Canton-S  strain  Drosophila  obtained  by 
applying  ANF  to  actigraphy  data  as  compared  with  PRC  from  the  literature. 


